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INFORMATION RETRIEVAL APPARATUS 
AND METHOD 

BACKGROUND OF THE INVENTION 

This invention relates to an information retrieval appara- 
tus and method, and more particularly to an information 
retrieval apparatus and method wherein an image is fetched 
and a current position is detected and then, based on the 
position detected, image data which conforms with the 
fetched image is selected from among image data selectively 
stored in advance and a URL or the like corresponding to the 
selected image data is retrieved. 

In the Internet which is a world-wide computer network, 
a WWW (World Wide Web) which provides various infor- 
mation has been established. 

Here, for an information providing system available on 
the Internet, WWW developed by CERN (European Center 
for Nuclear Search) in Switzerland is known. This technol- 
ogy allows a user to browse information including text, 
image and voice for example in the hyper text form. Based 
on HTTP (Hyper Text Transfer Protocol), the information 
stored in a WWW server terminal is sent asynchronously to 
terminals such as personal computers. 

'Hie WWW server is constituted by server software called 
HTTP demon and HTML file in which hyper text informa- 
tion is stored. The hyper text information is described in a 
description language called HTML (Hyper Text Makeup 
Language). In the description of a hyper text by HTML, a 
logical structure of a document is expressed in a format 
specification called tag enclosed by "<" and ">". Description 
of linking to other information is made based in link 
information called anchor. A method in which a location at 
which required information is stored by the anchor is URL 
(Uniform Resource Locator). 

A protocol for transferring a file described in HTML on 
the TCP/IP network is HTTP. 'Hi is protocol has a capability 
of transferring a request for information from a client to the 
WWW server and the requested hyper text information 
stored in the HTML file to the client. 

Used by many as an environment for using WWW is 
client software such as Netscape Navigator (trademark) 
called WWW browser. 

Using the WWW browser, a file on a WWW server on the 
Internet which spreads in a world-wide scale corresponding 
to a URL, a so-called home page, can be automatically 
down-loaded, and as is called nctsurfing, a network service 
wherein home pages which are linked to each other are 
successively traced to observe various information sources 
of WWW can be enjoyed. 

It should be noted that demon denotes a program for 
executing control and processing in the background when 
performing a job in the UNIX environment. 

FIG. 8 illustrates a manner in which a terminal equipment 
such as a WWW server is connected to the Internet. 

Referring to FIG. 8, the WWW includes a large number 
of WWW servers 51 connected to the Internet. The WWW 
servers 51 provide home pages of the hyper text form and so 
forth to other terminal equipments connected to the Internet 
in response to accesses from them. 

In order to access such a WWW server 51 as described 
above, such a procedure is taken that a terminal equipment 
such as a work station 52 connected to the Internet is 
manually operated to access the WWW server 51 or a 65 
popular personal computer 53 to which a modem is con- 
nected is used to log in, via a telephone line, to a predeter- 
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mined host machine (access provider) 54 connected to the 
Internet and then access the WWW server 51 from the host 
machine 54. 

Accordingly, accessing to a WWW server 51 is normally 
performed indoors such as in an office in which such work 
station 52 is provided or in a house of an individual who 
owns such personal computer 53. 

Accordingly, for example, when it is intended to acquire, 
during shopping in a town, information of a certain shop in 
the town from a home page of the WWW, it is a possible 
procedure, for example, to connect a portable telephone set 
56 to a portable personal computer 55 provided with a 
modem, log in to the host machine 54 and access a WWW 
server 51. 

In such an instance, however, a URL (Uniform Resource 
Locator) of the home page which provides information of 
the shop must be remembered in advance. Further, where a 
portable telephone set is connected to and used with a 
portable personal computer with a modem, the overall 
system becomes bulky. Further, since a URL must be 
inputted using a keyboard, the operability is low when the 
system is used outdoors such as in a town. 

SUMMARY OF HIE INVENTION 

It is an object of the present invention to provide an 
information retrieval apparatus of a comparatively small size 
which does not require use of a keyboard and is high in 
operability. 

It is another object of the present invention to provide an 
information retrieval met hex! which does not require use of 
a keyboard and allows a good operability of an information 
retrieval apparatus. 

In order to attain the objects described above, according 
to the present invention, image data are stored in advance in 
predetermined storage locations corresponding to informa- 
tion to be provided, and an image fetched by a user is 
compared with the image data stored in advance and infor- 
mation corresponding to the image data conforming to the 
image is read out. 

In particular, according to an aspect of the present 
invention, there is provided an information retrieval appa- 
ratus for retrieving information from a data base which has 
registration data including position data, image data and 
designation information such as a URL for specification of 
individual information in a mutually corresponding 
relationship, comprising fetching means for fetching an 
image, position detection means for delecting a current 
position of the information retrieval apparatus, and selection 
means for selecting, from within the image data having the 
position data regarding positions around the current position 
detected by the position detection means, that of the desig- 
nation information having image data which matches with 
the image fetched by the fetching means. 

In the information retrieval apparatus, the fetching means 
fetches an image, and the position detection means detects 
a current position of the information retrieval apparatus. 
Then, the selection means selects, from within the image 
60 data having the position data regarding positions around the 
current position detected by the position detection means, 
that of the designation information having image data which 
matches with the image fetched by the fetching means. 

According to another aspect of the present invention, 
there is provided an information retrieval method for retriev- 
ing information from a data base which has registration data 
including position data, image data and designation infor- 
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mation for specification of individual information in a 
mutually corresponding relationship, comprising the steps of 
fetching an image, detecting a current position, and 
selecting, from within the image data having the position 
data regarding positions around the detected current 5 
position, that image data which matches with the fetched 
image. 

In the information retrieval method, an image is fetched 
and a current position is detected. Then, from with in the 
image data having the position data regarding positions 
around the detected current position, that image data which 
matches with the fetched image is selected. 

With the information retrieval apparatus and the informa- 
tion retrieval method, image data is read out from the data 
base based on a position when an image is fetched by a user, 
and information such as a URL corresponding to image data 
matching with the image fetched by the user is read out from 
the data base. Consequently, the necessity for use of a 
keyboard is eliminated. Further, since no keyboard need be 
provided, the apparatus can be formed in a reduced size and 
have an improved operability. 

The above and other objects, features and advantages of 
the present invention will become apparent from the fol- 
lowing description and the appended claims, taken in con- 
junction with the accompanying drawings in which like 
parts or elements are denoted by like reference characters. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing a construction of an 
information retrieval system which employs a portable ter- 
minal to which an information retrieval apparatus of the 
present invention is applied; 

FIG. 2 is a schematic illustration showing an image of a 
display screen upon registration of a URL by an information 
provider shown in FIG. 1; 

FIG. 3 is a schematic illustration showing an example of 
a display screen of image data registered in a corresponding 
relationship to a URL; 

FIG. 4 is a block diagram showing an example of a 
detailed construction of the portable terminal shown in FIG. 
1; 

FIG. 5 is a flow chart illustrating operation of the portable 
terminal of FIG. 4; 

FIG. 6 is an illustration showing a manner in which an 
image is fetched using the portable terminal of FIG. 4; 

FIG. 7 is a schematic view showing an example of a 
display of a home page provided by a WWW server; and 

FIG. 8 is a block diagram showing terminal equipments 
connected to the Internet. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

Referring first to FIG. 1, there is shown an example of an 
information retrieval system which makes use of an infor- 
mation retrieval apparatus of the present invention. 

In the information retrieval system, an information pro- 
vider 2 can make a WWW server 11 thereof hold informa- 
tion provided from the same and register a file or a home 
page (HTML file) stored in the WWW server 11 into a 
WWW data base 3 via the Internet. 

When a URL of a home page in the WWW server 11 is 
registered into the WWW data base 3, for example, columns 
or sections into which a URL, position data (latitude and 
longitude) and image data are displayed as seen in FIG. 2. 
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In the example of display shown in FIG. 2 t "http:// 
www.taxim.co.jp" is entered as the URL; "40_J 13' 10"" is 
entered as the latitude (position data); "135_/ 40' 05"" is 
entered as the longitude (position data); and "Posterl" is 
entered as the name (file name) of image data. 

Then, if a mouse or the like is manually operated to click 
a registration button at a lower portion of the screen shown 
in FIG. 2, then those data described above are registered into 
the WWW data base 3 via the Internet. Further, if an image 
display button is clicked, then an image of the file entered in 
the image data section is displayed, for example, as seen in 
FIG. 3. Consequently, contents of the image data to be 
registered can be confirmed. 

When the current position of a portable terminal 1 is in the 
proximity of the latitude of 40^/ 13* 10" and the longitude 
of 135 _J 40' 05", since such registration data as seen in FIG. 
2 coincide with the current position in retrieval of the 
position by the portable terminal 1, the WWW data base 3 
outputs the image data (data of Posterl) of the registration 
data to the portable terminal 1 via a host machine (access 
provider) 4. 

The WWW data base 3 holds the URL of the WWW 
server 11 in a corresponding relationship to the image data 
and the position data supplied thereto from the information 
provider 2. 

The host machine 4 is connected to the portable terminal 
1 by a telephone line (by radio), and accesses the WWW 
data base 3 or the WWW server II via the Internet in 
accordance with a signal supplied thereto from the portable 
terminal 1 and transfers data supplied thereto from the 
WWW data base 3 or the WWW server 11 to the portable 
terminal 1. 

The portable terminal 1 fetches an image and detects a 
?5 current position thereof. Then, the portable terminal 1 
retrieves position data around the current position from 
within the WWW data base 3 via the host machine 4 and 
reads out image data corresponding to the position data from 
the WWW data base 3 via the host machine 4. 
40 Further, the portable terminal 1 selects that of the image 
data supplied thereto from the WWW data base 3 which 
conforms to the fetched image (that image data which is 
discriminated to be an image of a picture or characters same 
as a picture (pattern) or characters exhibited in the fetched 
image) and reads out a URL corresponding to the image data 
from the WWW data base 3 via the host machine 4. 

FIG. 4 shows an example of a detailed construction of the 
portable terminal 1. Referring to FIG. 4, the portable termi- 
nal 1 shown includes a CPU (selection means) 21 which 
performs various processes in accordance with a program 
stored in a ROM 22. A RAM 23 temporarily stores data 
when the CPU 21 performs processing. 

A video camera 24 serving as fetching means fetches an 
. s image around the same and outputs the fetched digital image 
data to the CPU 21 via an interface 25. 

A GPS (Global Positioning System) 26 serving as position 
detection means detects a current position such as a latitude 
and a longitude at which the portable terminal 1 is positioned 
60 at present, and outputs the position data to the CPU 21 via 
the interface 25. 

A modem 27 serving as reception means outputs, under 
the control of the CPU 21, a predetermined signal to the host 
machine 4 via the telephone line (by radio). Further, the 
65 modem 27 supplies a signal from the host machine 4 
transmitted thereto via the telephone line (by radio) to the 
CPU 21 via the interface 25. 
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A CRT 28 displays an image of an acquired URL or home 
page under the control of the CPU 21. 

A manually operable button 29 is manually operated to 
fetch an image by means of a video camera 24 or to select 
a URL from among a plurality of URLs displayed on the 5 
CRT 28, and outputs a signal corresponding to the operation 
to the CPU 21 via the interface 25. 

Subsequently, operation of the portable terminal 1 will be 
described with reference to a flow chart of FIG. 5. 

First in step SI, when a user manually operates the 10 
manually operable button 29, a signal representative of the 
operation is supplied to the CPU 21, and the video camera 
24 fetches, under the control of the CPU 21, an image 
around the same in a direction in which the portable terminal 
1 is directed. The video camera 24 supplies the thus fetched 15 
image data to the CPU 21 via the interface 25. The CPU 21 
stores the image data into the RAM 23. 

It is assumed that the user is walking in a town carrying 
the portable terminal 1. Further, it is assumed that, in the 
town, for example, such a poster 41 as shown in FIG. 6 is 
put up on a board. When the user is interested in the poster 
41 and tries to acquire detailed information relating to this, 
the user fetches an image of the poster 41 using the video 
camera 24. In the example shown in FIG. 6, an image of the ^ 
poster of "Restaurant Taxim de Paris" is fetched. 

ITien in step S2, the CPU 21 instructs the GPS 26 to delect 
the current position of the portable terminal 1. The GPS 26 
supplies the detected position data to the CPU 21 via the 
interface 25. The CPU 21 stores the position data into the 
RAM 23. 

Since the user has fetched the image at the position of, for 
example, the latitude of 40_7 13' 09" and the longitude of 
135 __7 40' 06" as seen in FIG. 6, the GPS 26 detects this 
position (latitude of 4()_J 1 3' 09" and longitude of 1 35__/ 40' ^ 
06") and outputs the position data to the CPU 21. 

In step S3, the CPU 21 requests the WWW data base 3 
through the modem 27 to perform retrieval of position data 
based on the position data supplied from the GPS 26. 

Ine WWW data base 3 retrieves those of the position data 40 
of the registration data which are data around the position 
supplied from the portable terminal 1 (that is, those position 
data which have coordinate values (in latitude and 
longitude) within a predetermined distance from the current 
position detected by the portable terminal 1). The WWW 45 
database 3 then reads out image data of the registration data 
corresponding to the thus retrieved position data and outputs 
them to the portable terminal 1. 

For example, when an image is fetched in such a situation 
as seen in FIG. 6, since the position detected by the portable 50 
terminal 1 is 40../ 13' 09" in latitude and 135_/ 40' 06" in 
longitude, the WWW data base 3 searches for those of the 
registered data whose position data is around 41) _f 13* 09" 
in latitude and I35_/40' 06" in longitude. 

Then, for example, if the restaurant named Taxim de Paris 55 
which acts as the information provider 2 has put the poster 
41 on a board as an advertisement and has a home page of 
WWW produced in a predetermined WWW server 11 and 
besides has an image and the location of the poster 41 
registered in the WWW data base 3 as seen in FIG. 2, since 60 
the location of the poster (40 _J 13* 10" in latitude and 135_J 
40' 05 M in longitude) is in the proximity of the current 

position (40 _j 13' 09" in latitude and 135 / 40' 06" in 

longitude) at which the user has fetched the image, image 
data (FIG. 3) of the registration of the poster 41 is retrieved 65 
from the WWW data base 3 and supplied to the portable 
terminal I via the host machine 4. 
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In step S4, the CPU 21 of the portable terminal 1 checks 
whether or not the image data read out from the WWW data 
base 3 matches with (corresponds to) the image fetched from 
the video camera 24. Then, in step S5, the CPU 21 checks 
the number of matching images, and if no matching image 
is detected, then the processing is ended. However, when an 
image or images match, the CPU 21 discriminates, in step 
S6, whether or not the number of matching images is 1. If 
the number of matching images is 1, then the control 
sequence advances to step S7. 

For example, when an image is read in in such a situation 
as seen in FIG. 6 and such image data as seen in FIG. 3 are 
supplied to the portable terminal 1, since the poster shown 
in FIG. 6 is drawn in a similar design to the image data of 
FIG. 3, the CPU 21 of the portable terminal 1 discriminates 
that the image data (FIG. 3) matches with the fetched image 
(FIG. 6). 

In step S7, the CPU 21 requests, via the modem 27, the 
WWW data base 3 to transfer of a URL corresponding to the 
conforming image. When the URL corresponding to the 
conforming image is acquired from the WWW data base 3, 
the portable terminal 1 accesses, in step S8, a WWW server 
11 which has the URL. 

In response to the accessing, the WWW server 11 outputs 
image data of the home page to the portable terminal 1. The 
portable terminal 1 receives, in step S9, the image data by 
means of the modem 27 and sends the image data to the CRT 
28 so that they may be displayed on the CRT 28. 

For example, when such registration data of "Restaurant 
Taxim de Paris" as seen in FIG. 2 arc searched out in the 
retrieval, a URL of "http://www.taxim.co.jp" is read out 
from the WWW data base 3 and supplied to the portable 
terminal 1 via the host machine 4. 

'ITien, the portable terminal 1 accesses the WWW server 
11 designated by http://www.taxim.co.jp and receives such 
image data of the home page of "Restaurant Taxim de Paris" 
as seen in FIG. 7 from the WWW server 11. The image data 
are displayed on the CRT 28 of the portable terminal 1. 

On the other hand, when it is discriminated in step S6 that 
the number of matching images is two or more, the control 
sequence advances to step S10, in which the portable 
terminal 1 requests the WWW data base 3 to transfer URLs 
corresponding to all of the conforming images. 

The host machine 4 thus acquires URLs corresponding to 
all of the conforming images from the WWW data base 3 
and outputs the URLs to the portable terminal 1. The 
portable terminal 1 receives the URLs and controls the CRT 
28 to display them. 

Then, in step Sll, the user will manually operate the 
manually operable button 29 to select one of the URLs 
displayed on the CRT 28. The CPU 21 outputs the selected 
URL to the Internet via the modem 27. Consequently, 
accessing to the WWW server 11 designated by the URL is 
performed in step S8. 

The host machine 4 outputs, when the home page is 
received from the WWW server 11 accessed by it, the image 
data of the home page to the portable terminal 1. 'Mien, in 
step S9, the portable terminal 1 controls the CRT 28 to 
display the image of the home page received. 

In this manner, the portable terminal 1 acquires a URL of 
a predetermined WWW server from the WWW data base 3 
making use of a fetched image and data of the current 
position, and accesses the WWW server. 

It is to be noted that, while, in the embodiment described 
above, an information retrieval apparatus of the present 
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invention is applied to the portable terminal 1, it may 
otherwise he applied to a vehicle -carried terminal. In this 
instance, a URL is registered together with image data of 
road-signs, signboards and billboards along a road and 
detailed information is stored in a predetermined WWW 
server in advance. Then, when a user fetches an image of one 
of the road -signs, signboards and billboards, detailed infor- 
mation of it is read out from the predetermined WWW 
server. 

Further, while, in the embodiment described above, the 
portable terminal I accesses the WWW data base 3 to 
perform retrieval when an image is fetched, image data and 
position data may be stored once into the RAM 23 so thai, 
later at a different location (for example, after the user comes 
home), retrieval may be performed making use of the image 
data and the position data. 

Furthermore, while, in the embodiment described above, 
the GPS 26 is utilized for detection of a position, the PHS 
(Personal Handy phone System) may be utilized alterna- 
tively. Since the PHS employs comparatively weak radio 
waves, a radio wave of a PHS terminal arrives only at a 
neighboring relay station or stations. Accordingly, in other 
words, when a relay station receives a radio wave, a PHS 
terminal is used around the relay station. Consequently, the 
position (region) in which a PHS terminal is used can be 
specified to a narrower range. 

Further, where a PHS circuit is provided in the modem 27, 
communication with the host machine 4 and position detec- 
tion can be performed by the PHS circuit. Consequently, the 
GPS 26 is unnecessary. Accordingly, the number of parts of 
the portable terminal 1 can be reduced, and the portable 
terminal 1 can be formed as an apparatus of a reduced size. 

In addition, while, in the embodiment described above, a 
WWW of the Internet is utilized, it is otherwise possible to 
built up a simitar system in a computer network other than 
the Internet to perform retrieval of information. 

Having now fully described the invention, it will be 
apparent to one of ordinary skill in the art that many changes 
and modifications can be made thereto without departing 
from the spirit and scope of the invention as set forth herein. 

What is claimed is: 

1. An information retrieval apparatus for retrieving infor- 
mation from a data base which contains registration data 
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including position data, image data and designation infor- 
mation for retrieval of additional information comprising: 

imaging means for obtaining an image; 

location detection means for detecting a current position 

location of said information retrieval apparatus; and 
selection means for selecting image data from said data 
base which corresponds to the image obtained by said 
imaging means, said image data having position data 
representing positions in the vicinity of the current 
position location detected by said location detection 
means, and said designation information corresponding 
lo said image data for retrieving said additional infor- 
mation. 

15 2. An information retrieval apparatus according to claim 

1, further comprising reception means for receiving the 
image data and the designation information via a computer 
network. 

3. An information retrieval apparatus according to claim 
20 2, wherein said reception means has a portable telephone 

function and is connected to said computer network via a 
telephone line. 

4. An information retrieval apparatus according to claim 

2, wherein the designation information is a URL for speci- 
25 fying information stored in a server of a world wide web 

build up on the Internet. 

5. An information retrieval method for retrieving infor- 
mation by information retrieval apparatus from a data base 
which contains registration data including position data, 

30 image data and designation information for retrieval of 
additional information, comprising the steps of: 
obtaining an image; 

detecting the current position location of the information 
3 5 retrieval apparatus; and 

selecting image data from said data base which corre- 
sponds to the image obtained, said image data having 
position data representing positions in the vicinity of 
the detected current position location of the information 
40 retrieval apparatus, and designation information corre- 
sponding to said image data for retrieving said addi- 
tional information. 
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INFORMATION RETRIEVAL APPARATUS 
AND METHOD 

BACKGROUND OF THE INVENTION 

This invention relates to an information retrieval appara- 5 
tus and method, and more particularly to an information 
retrieval apparatus and method wherein an image is fetched 
and a current position is detected and then, based on the 
position detected, image data which conforms with the 
fetched image is selected from among image data selectively 10 
stored in advance and a URL or the like corresponding to the 
selected image data is retrieved. 

In the Internet which is a world-wide computer network, 
a WWW (World Wide Web) which provides various infor- 
mation has been established. 

Here, for an information providing system available on 
the Internet, WWW developed by CERN (European Center 
for Nuclear Search) in Switzerland is known. This technol- 
ogy allows a user to browse information including text, 20 
image and voice for example in the hyper text form. Based 
on HTTP (Hyper Text Transfer Protocol), the information 
stored in a WWW server terminal is sent asynchronously to 
terminals such as personal computers. 

The WWW server is constituted by server software called 25 
HTTP demon and HTML file in which hyper, text informa- 
tion is stored. The hyper text information is described in a 
description language called HTML (Hyper Text Makeup 
Language). In the description of a hyper text by HTML, a 
logical structure of a document is expressed in a format 30 
specification called tag enclosed by "<" and ">". Description 
of linking to other information is made based in link 
information called anchor. A method in which a location at 
which required information is stored by the anchor is URL 
(Uniform Resource Locator). 35 

A protocol for transferring a file described in HTML on 
the TCP/IP network is HTTP. This protocol has a capability 
of transferring a request for information from a client to the 
WWW server and the requested hyper text information 
stored in the HTML file to the client. *° 

Used by many as an environment for using WWW is 
client software such as Netscape Navigator (trademark) 
called WWW browser. 

Using the WWW browser, a file on a WWW server on the 
Internet which spreads in a world-wide scale corresponding 
to a URL, a so-called home page, can be automatically 
down-loaded, and as is called netsurfing, a network service 
wherein home pages which are linked to each other are 
successively traced to observe various information sources ^ 
of WWW can be enjoyed. 

It should be noted that demon denotes a program for 
executing control and processing in the background when 
performing a job in the UNIX environment. 

FIG. 8 illustrates a manner in which a terminal equipment 55 
such as a WWW server is connected to the Internet. 

Referring to FIG. 8, the WWW includes a large number 
of WWW servers 51 connected to the Internet. The WWW 
servers 51 provide home pages of the hyper text form and so 
forth to other terminal equipments connected to the Internet go 
in response to accesses from them. 

In order to access such a WWW server 51 as described 
above, such a procedure is taken that a terminal equipment 
such as a work station 52 connected to the Internet is 
manually operated to access the WWW server 51 or a 65 
popular personal computer 53 to which a modem is con- 
nected is used lo log in, via a telephone line, to a predeler- 
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mined host machine (access provider) 54 connected to the 
Internet and then access the WWW server 51 from the host 
machine 54. 

Accordingly, accessing to a WWW server 51 is normally 
performed indoors such as in an office in which such work 
station 52 is provided or in a house of an individual who 
owns such personal computer 53. 

Accordingly, for example, when it is intended to acquire, 
during shopping in a town, information of a certain shop in 
the town from a home page of the WWW, it is a possible 
procedure, for example, to connect a portable telephone set 
56 to a portable personal computer 55 provided with a 
modem, log in to the host machine 54 and access a WWW 
server 51. 

In such an instance, however, a URL (Uniform Resource 
Locator) of the home page which provides information of 
the shop must be remembered in advance. Further, where a 
portable telephone set is connected to and used with a 
portable personal computer with a modem, the overall 
system becomes bulky. Further, since a URL must be 
inputted using a keyboard, the operability is low when the 
system is used outdoors such as in a town. 

SUMMARY OF THE USTVENTTON 

25 

It is an object of the present invention to provide an 
information retrieval apparatus of a comparatively small size 
which does not require use of a keyboard and is high in 
operability. 

30 It is another object of the present invention to provide an 
information retrieval method which does not require use of 
a keyboard and allows a good operability of an information 
retrieval apparatus. 

In order to attain the objects described above, according 
to the present invention, image data are stored in advance in 
predetermined storage locations corresponding to informa- 
tion to be provided, and an image fetched by a user is 
compared with the image data stored in advance and infor- 
^ mation corresponding to the image data conforming to the 
image is read out. 

In particular, according to an aspect of the present 
invention, there is provided an information retrieval appa- 
ratus for retrieving information from a data base which has 
45 registration data including position data, image data and 
designation information such as a URL for specification of 
individual information in a mutually corresponding 
relationship, comprising fetching means for fetching an 
image, position detection means for detecting a current 
50 position of the information retrieval apparatus, and selection 
means for selecting, from within the image data having the 
position data regarding positions around the current position 
detected by the position detection means, that of the desig- 
nation information having image data which matches with 
55 the image fetched by the fetching means. 

In the information retrieval apparatus, the fetching means 
fetches an image, and the position detection means detects 
a current position of the information retrieval apparatus. 
Then, the selection means selects, from within the image 
60 data having the position data regarding positions around the 
current position detected by the position detection means, 
that of the designation information having image data which 
matches with the image fetched by the fetching means- 
According to another aspect of the present invention, 
65 there is provided an information retrieval method for retriev- 
ing information from a data base which has registration data 
including position data, image data and designation infor- 
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matioa for specification of individual information in a 
mutually corresponding relationship, comprising the steps of 
fetching an image, detecting a current position, and 
selecting, from within the image data having the position 
data regarding positions around the detected current 5 
position, that image data which matches with the fetched 
image. 

In the information retrieval method, an image is fetched 
and a current position is detected. Then, from with in the 
image data having the position data regarding positions 10 
around the detected current position, that image data which 
matches with the fetched image is selected. 

With the information retrieval apparatus and the informa- 
tion retrieval method, image data is read out from the data 
base based on a position when an image is fetched by a user, 15 
and information such as a URL corresponding to image data 
matching with the image fetched by the user is read out from 
the data base. Consequently, the necessity for use of a 
keyboard is eliminated. Further, since no keyboard need be 
provided, the apparatus can be formed in a reduced size and 20 
have an improved operability. 

The above and other objects, features and advantages of 
the present invention will become apparent from the fol- 
lowing description and the appended claims, taken in con- 25 
junction with the accompanying drawings in which like 
parts or elements are denoted by like reference "characters. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram showing a construction of an 30 
information retrieval system which employs a portable ter- 
minal to which an information retrieval apparatus of the 
present invention is applied; 

FIG. 2 is a schematic illustration showing an image of a 
display screen upon registration of a URL by an information 35 
provider shown in FIG. 1; 

FIG. 3 is a schematic illustration showing an example of 
a display screen of image data registered in a corresponding 
relationship to a URL; 

FIG. 4 is a block diagram showing an example of a 
detailed construction of the portable terminal shown in FIG. 

l; 

FIG. 5 is a flow chart illustrating operation of the portable 
terminal of FIG. 4; 45 

FIG. 6 is an illustration showing a manner in which an 
image is fetched using the portable terminal of FIG. 4; 

FIG. 7 is a schematic view showing an example of a 
display of a home page provided by a WWW server; and 

FIG. 8 is a block diagram showing terminal equipments 50 
connected to the Internet. 



DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

Referring first to FIG. 1, there is shown an example of an 
information retrieval system which makes use of an infor- 
mation retrieval apparatus of the present invention. 

In the information retrieval system, an information pro- 
vider 2 can make a WWW server 11 thereof hold informa- $0 
tion provided from the same and register a file or a home 
page (HTML file) stored in the WWW server 11 into a 
WWW data base 3 via the Internet. 

When a URL of a home page in the WWW server 11 is 
registered into the WWW data base 3, for example, columns 65 
or sections into which a URL, position data (latitude and 
longitude) and image data are displayed as seen in FIG. 2. 
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In the example of display shown in FIG. 2, "http:// 
www.taxira.co.jp" is entered as the URL; "40 _J 13' 1(T" is 
entered as the latitude (position data); "135 _J 40' 05"" is 
entered as the longitude (position data); and "Posterl" is 
5 entered as the name (file name) of image data. 

Then, if a mouse or the like is manually operated to click 
a registration button at a lower portion of the screen shown 
in FIG. 2, then those data described above are registered into 
the WWW data base 3 via the Internet. Further, if an image 
10 display button is clicked, then an image of the file entered in 
the image data section is displayed, for example, as seen in 
FIG. 3. Consequently, contents of the image data to be 
registered can be confirmed. 

When the current position of a portable terminal 1 is in the 
15 proximity of the latitude of 40 _J 13' 10" and the longitude 
of 135 _J40' 05", since such registration data as seen in FIG. 
2 coincide with the current position in retrieval of the 
position by the portable terminal 1, the WWW data base 3 
outputs the image data (data of Posterl) of the registration 
20 data to the portable terminal 1 via a host machine (access 
provider) 4. 

The WWW data base 3 holds the URL of the WWW 
server 11 in a corresponding relationship to the image data 
25 and the position data supplied thereto from the information 
provider 2. 

The host machine 4 is connected to the portable terminal 
1 by a telephone line (by radio), and accesses the WWW 
data base 3 or the WWW server 11 via the Internet in 
30 accordance with a signal supplied thereto from the portable 
terminal 1 and transfers data supplied thereto from the 
WWW data base 3 or the WWW server 11 to the portable 
terminal 1. 

The portable terminal 1 fetches an image and detects a 

35 current position thereof. Then, the portable terminal 1 
retrieves position data around the current position from 
within the WWW data base 3 via the host machine 4 and 
reads out image data corresponding to the position data from 
the WWW data base 3 via the host machine 4. 

40 Further, the portable terminal 1 selects that of the image 
data supplied thereto from the WWW data base 3 which 
conforms to the fetched image (that image data which is 
discriminated to be an image of a picture or characters same 
as a picture (pattern) or characters exhibited in the fetched 

45 image) and reads out a URL corresponding to the image data 
from the WWW data base 3 via the host machine 4. 

FIG. 4 shows an example of a detailed construction of the 
portable terminal 1. Referring to FIG. 4, the portable termi- 
nal 1 shown includes a CPU (selection means) 21 which 

50 performs various processes in accordance with a program 
stored in a ROM 22. A RAM 23 temporarily stores data 
when the CPU 21 performs processing. 

A video camera 24 serving as fetching means fetches an 

55 image around the same and outputs the fetched digital image 
data to the CPU 21 via an interface 25. 

A GPS (Global Positioning System) 26 serving as position 
detection means detects a current position such as a latitude 
and a longitude at which the portable terminal 1 is positioned 

60 at present, and outputs the position data to the CPU 21 via 
the interface 25. 

A modem 27 serving as reception means outputs, under 
the control of the CPU 21, a predetermined signal to the host 
machine 4 via the telephone line (by radio). Further, the 

65 modem 27 supplies a signal from the host machine 4 
transmitted thereto via the telephone line (by radio) to the 
CPU 21 via the interface 25. 
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A CRT 28 displays an image of an acquired URL or home 
page under the control of the CPU 21. 

A manually operable button 29 is manually operated to 
fetch an image by means of a video camera 24 or to select 
a URL from among a plurality of URLs displayed on the 5 
CRT 28, and outputs a signal corresponding to the operation 
to the CPU 21 via the interface 25. 

Subsequently, operation of the portable terminal 1 will be 
described with reference to a flow chart of FIG. 5. 

First in step SI, when a user manually operates the 30 
manually operable button 29, a signal representative of the 
operation is supplied to the CPU 21, and the video camera 
24 fetches, under the control of the CPU 21, an image 
around the same in a direction in which the portable terminal 
1 is directed. The video camera 24 supplies the thus fetched 15 
image data to the CPU 21 via the interface 25. The CPU 21 
stores the image data into the RAM 23. 

It is assumed that the user is walking in a town carrying 
the portable terminal 1. Further, it is assumed that, in the 
town, for example, such a poster 41 as shown in FIG. 6 is 20 
put up on a board. When the user is interested in the poster 
41 and tries to acquire detailed information relating to this, 
the user fetches an image of the poster 41 using the video 
camera 24. In the example shown in FIG. 6, an image of the 
poster of "Restaurant Taxim de Paris" is fetched. 

Then in step S2, the CPU 21 instructs the GPS 26 to detect 
the current position of the portable terminal 1. The GPS 26 
supplies the detected position data to the CPU 21 via the 
interface 25. The CPU 21 stores the position data into the 
RAM 23. 

Since the user has fetched the image at the position of, for 
example, the latitude of 40_J 13* 09" and the longitude of 
\35_i 40' 06" as seen in FIG. 6, the GPS 26 detects this 
position (latitude of 40_J 13' 09" and longitude of 135_7 40' 35 
06") and outputs the position data to the CPU 21. 

In step S3, the CPU 21 requests the WWW data base 3 
through the modem 27 to perform retrieval of position data 
based on the position data supplied from the GPS 26. 

The WWW data base 3 retrieves those of the position data 40 
of the registration data which are data around the position 
supplied from the portable terminal 1 (that is, those position 
data which have coordinate values (in latitude and 
longitude) within a predetermined distance from the current 
position detected by the portable terminal 1). The WWW 45 
data base 3 then reads out image data of the registration data 
corresponding to the thus retrieved position data and outputs 
them to the portable terminal 1. 

For example, when an image is fetched in such a situation 
as seen in FIG. 6, since the position detected by the portable 50 
terminal 1 is 40_/ 13' 09" in latitude and 135 _J 40* 06" in 
longitude, the WWW data base 3 searches for those of the 
registered data whose position data is around 40^/ 13' 09" 
in latitude and 135.J 40" 06" in longitude. 

Then, for example, if the restaurant named Taxim de Paris 55 
which acts as the information provider 2 has put the poster 
41 on a board as an advertisement and has a home page of 
WWW produced in a predetermined WWW server 11 and 
besides has an image and the location of the poster 41 
registered in the WWW data base 3 as seen in FIG. 2, since 60 
the location of the poster (40 _j 13' 10" in latitude and 135_y 
40' 05" in longitude) is in the proximity of the current 
position (40 J 13* 09" in latitude and 135 _/ 40' 06* in 
longitude) at which the user has fetched the image, image 
data (FIG. 3) of the registration of the poster 41 is retrieved 65 
from the WWW data base 3 and supplied to the portable 
terminal 1 via the host machine 4. 
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In step S4, the CPU 21 of the portable terminal 1 checks 
whether or not the image data read out from the WWW data 
base 3 matches with (corresponds to) the image fetched from 
the video camera 24. Then, in step S5, the CPU 21 checks 

5 the number of matching images, and if no matching image 
is detected, then the processing is ended. However, when an 
image or images match, the CPU 21 discriminates, in step 
S6, whether or not the number of matching images is 1. If 
the number of matching images is 1, then the control 

10 sequence advances to step S7. 

For example, when an image is read in in such a situation 
as seen in FIG. 6 and such image data as seen in FIG. 3 are 
supplied to the portable terminal 1, since the poster shown 
in FIG. 6 is drawn in a similar design to the image data of 

15 FIG. 3, the CPU 21 of the portable terminal 1 discriminates 
that the image data (FIG. 3) matches with the fetched image 
(FIG. 6). 

In step S7, the CPU 21 requests, via the modem 27, the 
WWW data base 3 to transfer of a URL corresponding to the 

20 conforming image. When the URL corresponding to the 
conforming image is acquired from the WWW data base 3, 
the portable terminal 1 accesses, in step S8, a WWW server 
11 which has the URL. 

25 In response to the accessing, the WWW server 11 outputs 
image data of the home page to the portable terminal 1. The 
portable terminal 1 receives, in step S9, the image data by 
means of the modem 27 and sends the image data to the CRT 
28 so that they may be displayed on the CRT 28. 

30 For example, when such registration data, of "Restaurant 
Taxim de Paris" as seen in FIG. 2 are searched out in the 
retrieval, a URL of "http://www.taxim.co.jp" is read out 
from the WWW data base 3 and supplied to the portable 
terminal 1 via the host machine 4. 

35 Then, the portable terminal 1 accesses the WWW server 
11 designated by http://www.taxim.co.jp and receives such 
image data of the home page of "Restaurant Taxim de Paris" 
as seen in FIG. 7 from the WWW server 11. The image data 
are displayed on the CRT 28 of the portable terminal 1. 

40 On the other hand, when it is discriminated in step S6 that 
the number of matching images is two or more, the control 
sequence advances to step S10, in which the portable 
terminal 1 requests the WWW data base 3 to transfer URLs 
corresponding to all of the conforming images. 

45 The host machine 4 thus acquires URLs corresponding to 
all of the conforming images from the WWW data base 3 
and outputs the URLs to the portable terminal 1. The 
portable terminal 1 receives the URLs and controls the CRT 
28 to display them. 

Then, in step Sll, the user will manually operate the 
manually operable button 29 to select one of the URLs 
displayed on the CRT 28. The CPU 21 outputs the selected 
URL to the Internet via the modem 27. Consequently, 

55 accessing to the WWW server 11 designated by the URL is 
performed in step S8. 

The host machine 4 outputs, when the home page is 
received from the WWW server 11 accessed by it, the image 
data of the home page to the portable terminal 1. Then, in 

60 step S9, the portable terminal 1 controls the CRT 28 to 
display the image of the home page received. 

In this manner, the portable terminal 1 acquires a URL of 
a predetermined WWW server from the WWW data base 3 
making use of a fetched image and data of the current 

65 position, and accesses the WWW server. 

It is to be noted that, while, in the embodiment described 
above, an information retrieval apparatus of the present 



